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MEDICAL IMAGING SYSTEMS 

Government Interests 

The United States Government has certain rights in this invention pursuant to 
National Institute of Health Grant # R21CA88245 and Department of Energy Grant 
5 # DE-FG02-01ER63188. 



Background of the Invention 

Absorption and fluorescent dyes, such as indocyanine green, have proven 
useful for medical imaging applications. Some of the more commonly used dyes 

10 share a number of useful characteristics. First, the dyes are suitable for labeling 
antibodies or low-molecular-weight ligands of diagnostic significance, or otherwise 
adapted for sequestration or preferential uptake at a site of interest such as a lesion. 
The dyes are safe for injection or other introduction into a live subject. And finally, 
the dyes emit light at a specific wavelength when excited, so that their location and 

1 5 concentration may be tracked. 

A number of imaging systems have been devised to detect and display these 
dyes within living tissue. For example, dyes such as indocyanine green have been 
used to visualize blood flow in eyes. In some cases, such as U.S. Pat. No. 6,293,91 1 

20 to Imaizumi et al., a dye imaging device has been combined with a visible light 
imaging system. Imaizumi describes endoscopic tools that generate images of dye- 
labeled antibodies superimposed over visible light images captured from within the 
body. As a significant disadvantage, the Imaizumi system employs a number of 
separate cavities within an endoscopic tool for light sources and image capture, thus 

25 requiring a greater cross-sectional area for the endoscope. As a further 
disadvantage, the Imaizumi patent only discloses endoscopic applications, and may 
not be suitable for use in open surgical applications where ambient light may extend 
into the excitation and/or emission wavelengths of the dye. 
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There remains a need for improved surgical and diagnostic imaging tools 
capable of generating circulatory blood flow images or other functional images 
along with visible light images of a subject. 

5 Summary Of The Invention 

A medical imaging system provides simultaneous rendering of visible light 
and fluorescent images. The system may employ dyes in a small-molecule form that 
remains in a subject's blood stream for several minutes, allowing real-time imaging 
of the subject's circulatory system superimposed upon a conventional, visible light 

10 image of the subject. The system may also employ dyes or other fluorescent 
substances associated with antibodies, antibody fragments, or ligands that 
accumulate within a region of diagnostic significance. In one embodiment, the 
system provides an excitation light source to excite the fluorescent substance and a 
visible light source for general iuumination within the same optical guide that is 

15 used to capture images. In another embodiment, the system is configured for use in 
open surgical procedures by providing an operating area that is closed to ambient 
light. More broadly, the systems described herein may be used in imaging 
applications where a visible light image may be usefully supplemented by an image 
formed from fluorescent emissions from a fluorescent substance that marks areas of 

20 functional interest. 

The medical imaging system may include a visible light source providing 
light over a range of wavelengths that includes one or more wavelengths of visible 
light, an excitation light source providing light at one or more wavelengths outside 

25 the range of wavelengths of the visible light source, the one or more wavelengths 
selected to excite a fluorescent substance, which emits one or more photons at an 
emission wavelength; an electronic imaging device; an optical guide having a first 
end with a lens that captures an image of a subject and a second end that couples the 
image to the electronic imaging device; and a filter for coupling the visible light 

30 source and the excitation light source into the optical guide, the filter reflecting some 
of the light provided by the visible light source and some of the light from the 
excitation light source toward the subject, the filter further transmitting some visible 
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light from the subject captured by the lens toward the electronic imaging device, and 
the filter further transmitting the emission wavelength from the subject captured by 
the lens toward the electronic imaging device. 

5 In another embodiment, the system may include a visible light source 

illuminating a subject, the visible light source providing a range of wavelengths 
including one or more wavelengths of visible light; an excitation light source 
illuminating the subject, the excitation light source providing an excitation 
wavelength that is not one of the one or more wavelengths of visible light; a 

10 fluorescent substance introduced into a circulatory system of the subject, the 
fluorescent substance being soluble in blood carried by the circulatory system and 
the fluorescent substance emitting photons at an emission wavelength in response to 
the excitation wavelength; an electronic imaging device that captures an image of a 
field of view that includes some portion of the subject and the circulatory system of 

15 the subject, the image including a first image obtained from the one 1 or more 
wavelengths of visible light and a second image obtained from the emission 
wavelength; and a display that renders the first image and the second image, the 
second image being displayed at a visible light wavelength. 

20 In another embodiment, the system may include an operating area closed to 

ambient light, the operating area including a surgical field where a surgical 
procedure may be performed on a subject; a visible light source illuminating the 
surgical field, the visible light source providing a range of wavelengths including 
one or more wavelengths of visible light; an excitation light source illuminating the 

25 surgical field, the excitation light source including at least one wavelength outside 
the range of wavelengths of visible light; a fluorescent substance suitable for in vivo 
use, the fluorescent substance fluorescing at an emission wavelength in response to 
the at least one wavelength of the excitation light source, the fluorescent substance 
being introduced into the surgical field; an electronic imaging device that captures a 

30 visible light image of the surgical field and an emission wavelength image of the 
surgical field; and a display that renders the visible light image and the emission 
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wavelength image of the surgical field, the emission wavelength image being 
displayed at a visible light wavelength. 

In another embodiment, the system may include a visible light source that 
5 illuminates a subject, the visible light source providing a range of wavelengths 
including one or more wavelengths of visible light; an excitation light source that 
illuminates the subject at the same time that the visible light source illuminates the 
subject, the excitation light source providing an excitation wavelength that is not one 
of the one or more wavelengths of visible light; a fluorescent substance introduced 
10 into a circulatory system of the subject, the fluorescent substance being soluble in 
blood carried by the circulatory system and the fluorescent substance emitting 
photons at an emission wavelength in response to the excitation wavelength; and an 
electronic imaging device that captures an image of a field of view that includes 
some portion of the subject and the circulatory system of the subject, the image 
15 including a first image obtained from the one or more wavelengths of visible light 
and a second image concurrently obtained from the emission wavelength. 

In the embodiments above, the one or more wavelengths of visible light 
from the visible light source may exclude far-red light, at least one of the excitation 
20 light source and the emission wavelength including a far-red light wavelength. The 
filter may be a dichroic mirror placed in the optical guide at a forty-five degree angle 
to a central axis of the optical guide. 

The system may include a second filter. The second filter may separate the 
25 emission wavelength from the range of wavelengths from the visible light source, 
the emission wavelength being directed toward a first optical transducer of the 
electronic imaging device and the range of wavelengths from the visible light source 
being directed toward a second optical transducer of the electronic imaging device. 
The second filter may separate the emission wavelength from the range of 
30 wavelengths from the visible light source, the emission wavelength being directed 
toward a first optical transducer of the electronic imaging device and the range of 
wavelengths from the visible light source being directed toward a second optical 
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transducer of the electronic imaging device wherein the second optical transducer 
separately senses at least each one of red, green, and blue light intensities. The 
second filter may separate the emission wavelength from the range of wavelengths 
from the visible light source, the emission wavelength being directed toward a first 

5 optical transducer of the electronic imaging device and the range of wavelengths 
from the visible light source being directed toward a second optical transducer of the 
electronic imaging device wherein the second optical transducer separately senses at 
least each one of cyan, magenta, and yellow light intensities. The second filter may 
separate title emission wavelength from the range of wavelengths from the visible 

1 0 light source, the emission wavelength being directed toward a first optical transducer 
of the electronic imaging device and the range of wavelengths from the visible light 
source being directed toward a second optical transducer of the electronic imaging 
device wherein the second filter includes a dichroic mirror that reflects the emission 
wavelength and transmits the one or more wavelengths of visible light from the 

15 visible light source. The second filter may separate the emission wavelength from 
the range of wavelengths from the visible light source, the emission wavelength 
being directed toward a first optical transducer of the electronic imaging device and 
the range of wavelengths from the visible light source being directed toward a 
second optical transducer of the electronic imaging device wherein the second filter 

20 includes a dichroic mirror that reflects the one or more wavelengths of visible light 
from the visible light source and transmits the emission wavelength. The second 
filter may shape the wavelengths of the visible light source. 

The electronic imaging device may include at least one charge-coupled 
25 device. The excitation light source may include a laser. The electronic imaging 
device may include a video camera sensitive to visible light, the electronic imaging 
device may include an emission wavelength camera. The electronic imaging device 
may capture a visible light image and an emission wavelength image, the system 
further including a processor that converts the emission wavelength image to a 
30 converted image having one or more visible light components, and combines the 
converted image with the visible light image for display. The electronic imaging 
device may capture a visible light image and an emission wavelength image, the 



5 



WO 03/077749 



PCT/US03/07596 



system further including a processor that converts the emission wavelength image to 
a converted image having one or more visible light components, and superimposes 
the converted image onto the visible light image for display. 

5 The electronic imaging device may capture a visible light image and an 

emission wavelength image, the visible light image being captured at thirty frames 
per second and the emission wavelength being captured at fifteen frames per second, 
the emission wavelength being converted to thirty frames per second for 
combination with the visible light image. The electronic imaging device may 

10 capture a visible light image and an emission wavelength image, wherein the visible 
light image is captured at thirty frames per second and the emission wavelength is 
captured at fifteen frames per second, the visible light image being converted to 
fifteen frames per second for combination with the emission wavelength image. 

15 The system may include a display that displays images captured by the 

electronic imaging device. The display may be provided to a physician for use 
during a procedure, the procedure being at least one of a diagnostic procedure or a 
therapeutic procedure. The display may include a surgical microscope. 

20 The fluorescent substance may label at least one of an antibody, an antibody 

fragment, or a low-molecular-weight ligand that accumulates at a lesion, the system 
being used to visualize the lesion. The fluorescent substance may be soluble in 
blood, the system being used to visualize a blood system. The display may render 
the second image of the circulatory system superimposed on the first image of the 

25 subject. The fluorescent substance may be a fluorescent dye injected into the subject 
by an intravenous injection. The fluorescent substance may be sprayed onto the 
subject. The fluorescent substance may be one or more quantum dots. The 
fluorescent substance may include at least one of indocyanine green; fluorescein; 
methylene blue, and IKDye78-CA. 

30 
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The fluorescent substance may be a dye having a structure of the formula: 




wherein, as valence and stability permit, 
X represents C(R) 2 , S, Se, O, or NR 5 ; 
5 R represents H or lower alkyl, or two occurrences of R, taken together, form a ring 

together with the carbon atoms through which they are connected; 
Ri and R 2 represent, independently, substituted or unsubstituted lower alkyl, lower 

alkenyl, cycloalkyl, cycloalkylalkyl, aryl, or aralkyl; 
R 3 represents, independently for each occurrence, one or more substituents to the 
10 ring to which it is attached; 

R4 represents H, halogen, or a substituted or unsubstituted ether or thioether of 

phenol or thiophenol; and 
R 5 represents, independently for each occurrence, substituted or unsubstituted lower 
alkyl, cycloalkyl, cycloalkylalkyl, aryl, or aralkyl. 

15 

A method as described herein may include illuminating a subject with one or 
more wavelengths of visible light; concurrently illuminating the subject with an 
excitation wavelength that is not one of the one or more wavelengths of visible light; 
introducing a fluorescent substance into a circulatory system of the subject, the 

20 fluorescent substance being soluble in blood carried by the circulatory system and 
the fluorescent substance emitting photons at an emission wavelength in response to 
the excitation wavelength; electronically capturing a visible light image of the 
subject; electronically capturing an emission wavelength image of the subject that 
shows the circulatory system; and displaying concurrently the visible light image of 

25 the subject and the emission wavelength image of the circulatory system. 
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In another embodiment, a method as described herein may include: 
enclosing a subject in an operating area closed to ambient light; illuminating the 
subject with one or more wavelengths of visible light; concurrently illuminating the 
subject with an excitation wavelength that is not one of the one or more wavelengths 
5 of visible light; introducing a fluorescent substance into the subject, the fluorescent 
substance emitting photons at an emission wavelength in response to the excitation 
wavelength; electronically capturing a visible light image of the subject; 
electronically capturing an emission wavelength image of the subject; and 
displaying concurrently the visible light image and the emission wavelength. 

10 

In another embodiment, a method described herein may include: providing 
one or more wavelengths of visible light; providing an excitation wavelength that is 
not one of the one or more wavelengths of visible light; introducing a fluorescent 
substance into a subject, Ihe fluorescent substance emitting photons at an emission 

15 wavelength in response to the excitation wavelength; providing a laparoscope 
having a first optical path that directs the one or more wavelengths of visible light 
toward a subject, a second optical path that directs the excitation wavelength toward 
the subject, and a third optical path that directs an emission wavelength and the one 
or more wavelengths of visible light from the subject to an imaging device; making 

20 an incision in a body that includes the subject; directing the laparoscope into the 
incision so that the subject is within a field of view of the laparoscope; and 
displaying concurrently a visible light image of the subject and the emission 
wavelength image of the subject. At least two of the first optical path, the second 
optical path, and the third optical path may be coaxial. 

25 

In another embodiment, a method described herein may include: providing 
one or more wavelengths of visible light; providing an excitation wavelength that is 
not one of the one or more wavelengths of visible light; introducing a fluorescent 
substance into a subject, the fluorescent substance emitting photons at an emission 
30 wavelength in response to the excitation wavelength; providing an endoscope having 
an optical path for directing images of the subject to an imaging device; coupling the 
excitation wavelength and the one or more wavelengths of visible light into the 
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optical path; directing the endoscope into a body so that the subject is within a field 
of view of the endoscope; capturing an emission wavelength image of the subject 
and a visible light image of the subject at the imaging device; and displaying 
concurrently the visible light image of the subject and the emission wavelength 
5 image of the subject. 

The fluorescent substance may be a dye having a structure of the formula: 




wherein, as valence and stability permit, 
10 X represents C(R) 2 , S, Se, O, or NR 5 ; 

R represents H or lower alkyl, or two occurrences of R, taken together, form a ring 

together with the carbon atoms through which they are connected; 
Ri and R 2 represent, independently, substituted or unsubstituted lower alkyl, lower 
alkenyl, cycloalkyl, cycloalkylalkyl, aryl, or aralkyl; 
15 R 3 represents, independently for each occurrence, one or more substituents to the 
ring to which it is attached; 
R4 represents H, halogen, or a substituted or unsubstituted ether or thioether of 
phenol or thiophenol; and 

R 5 represents, independently for each occurrence, substituted or 
20 unsubstituted lower alkyl, cycloalkyl, cycloalkylalkyl, aryl, or aralkyl. 

Brief Description Of Drawings 

The invention will be appreciated more folly from the following further 
25 description thereof, with reference to the accompanying drawings, wherein: 
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Fig. 1 shows an embodiment of an imaging system for use during open 
surgery; 

Fig. 2 shows a near-infrared window used by the imaging system; 
Fig. 3 shows an embodiment of an imaging system for use in an endoscopic 
5 tool; and 

Fig. 4 shows an image displaying both a circulatory system and surrounding 

tissue. 

Detailed Description of Certain Embodiments of the Invention 

10 To provide an overall understanding of the invention, certain illustrative 

embodiments will now be described, including a system for generating 
superimposed circulatory and tissue images in video format. However, it will be 
understood that the methods and systems described herein can be suitably adapted to 
other medical imaging applications where visible light tissue images may be usefully 

15 displayed with diagnostic image information obtained from outside the visible light 
range and superimposed onto the visible light image. More generally, the methods 
and systems described herein may be adapted to any imaging application where a 
visible light image may be usefully displayed with a superimposed image captured 
from areas within the visible light image that are functionally marked to emit 

20 photons outside the visible light range by a dye or other material. For example, the 
systems and methods are applicable to a wide range of diagnostic or surgical 
applications where a target pathology, tissue type, or cell may be labeled with a 
fluorescent dye or other fluorescent substance. These and other applications of the 
systems described herein are intended to fall within the scope of the invention. 

25 Figure 1 shows an embodiment of an imaging system for use during open 

surgery. The imaging system 100 may include a visible light source 102, and 
excitation light source 104, a surgical field 106, a dye source 108 containing a dye 
110, a lens 112, a first filter 114, a second filter 116, a third filter 118, a near- 
infrared camera 120, a video camera 122, an image processing unit 124, and a 

30 display 126. In general, the visible light source 102 and the excitation light source 
104 illuminate the surgical field 106. The dye 1 10 may be introduced from the dye 

i 
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source 108, such as through injection into the bloodstream of a subject. An image 
from the surgical field 106 is then captured by two cameras, the video camera 122 
capturing a conventional, visible light image of the surgical field 106 and the near- 
infrared camera 120 capturing a diagnostic image based upon the distribution of the 
5 dye 110 in the surgical field 106. These images may be combined by the image 
processing unit 124 and presented on a display 126 where they may be used, for 
example, by a surgeon conducting a surgical procedure. Each aspect of the system 
100 is now described in more detail. 

10 The imaging system 100 may be surrounded by an operating area (not 

shown) closed to ambient light. As will become clear from the following, many 
visible light sources such as incandescent lamps, halogen lamps, or daylight may 
include a broad spectrum of electromagnetic radiation that extends beyond the range 
of visible light detected by the human eye and into wavelengths used in the present 

15 system as a separate optical channel for generating diagnostic images. In order to 
effectively detect emission in these super-visible light wavelengths, it is preferred to 
enclose the surgical field 106, light sources 102, 104, and cameras 120, 122 in an 
area that is not exposed to broadband light sources. This may be achieved by using 
an operating room closed to external light sources, or by using a hood or other 

20 enclosure or covering for the surgical field 106 that prevents invasion by unwanted 
spectrum. The visible light source 102 may then serve as a light source for the 
visible light camera 122, and also for provide conventional lighting within the 
visible light spectrum. As used herein, the term "operating area" is intended 
specifically to refer to an open surgical site that is closed to ambient light. 

25 Endoscopic or laparoscopic applications, as described below, are confined to 
surgical procedures within a closed body cavity, and do not include an operating 
area as that term is intended herein. 

The visible light source 102 may be, for example, a near-infrared depleted 
30 white light source. This may be a one-hundred fifty Watt halogen lamp with one or 
more filters to deplete wavelengths greater than 700 nanometers ("ran"). Generally, 
any light source constrained to wavelengths between 400 nm and 700 nm may 
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operate as the visible light source 102. In certain applications, the excitation light 
source 104 and resulting emission from the dye 110 may have wavelengths near or 
below 700 mn, as with Cy5 dye, which emits light when excited at 650 nm. These 
near-red dyes may be used with the present system, however, this requires a visible 

5 light source 102 that excludes a portion of the visible light spectrum in which the 
dye operates, i.e., a far-red depleted white light source. Similarly, applications using 
quantum dots as a fluorescent substance may have absorption or emission 
wavelengths anywhere in the visible light spectrum, and a suitable visible light 
source should be depleted at the wavelength(s) of interest. As such, the visible light 

1 0 source 1 02 should more generally be understood to be a source of light that includes 
some, but not necessarily all, of the wavelengths of visible light. 

It should also be understood that, in a far-red imaging system or infrared 
imaging system such as those noted above, the near-infrared camera 120 described 

15 in the example embodiment will instead be a camera sensitive to the emission 
wavelength of the dye 110 or other fluorescent substance, and that other 
modifications to light sources, filters and other optics will be appropriate. Similar 
modifications may be made to isolate a band of wavelengths for dye excitation and 
emission anywhere within or outside the visible light range, provided that suitable 

20 optics, cameras, and dyes are available. Other fluorescent substances may also be 
used. For example, quantum dots may emit at visible light wavelengths, far-red, 
near-infrared, and infrared wavelengths, and at other wavelengths, typically in 
response to absorption below their emission wavelength. Suitable adjustments will 
be made to the excitation light source 104 and the emission camera, the near- 

25 infrared camera 120 in the example embodiment, for such applications. Cameras 
sensitive to far-red, near-infrared, and infrared wavelengths are commercially 
available. 

The excitation light source 104 provides light at a wavelength that excites the 
30 dye 1 10. This may be, for example, a laser diode such as a 771 nm, 250 mW laser 
diode system, which may be obtained from Laser Components of Santa Rosa, 
California. Other single wavelength, narrowband, or broadband light sources may 
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be used, provided they do not interfere with the visible light image captured by the 
video camera 122 or the emission wavelength of the dye 110. The near-infrared 
band is generally understood to include wavelengths between 700 nm and 1000 mn, 
and is a useful wavelength range for a number of readily available excitation light 
5 sources 104 and dyes 110 that may be used with the systems described herein. 
Suitable optical coupling and lenses may be provided to direct each of the visible 
light source 102 and the excitation light source 104 at an area of interest within the 
surgical field 106. 

10 The surgical field 106 may be any area of a subject or patient that is open for 

a surgical procedure. This may be, for example, an open chest during a procedure 
such as a revascularization or cardiac gene therapy, where visualization of the 
circulatory system may improve identification of areas at risk for myocardial 
infarction. Blood flow visualization may permit an assessment of coronary arteries 

15 during a coronary artery bypass graft, or an assessment of blood flow and viability 
during introduction of genes for endothelial growth factor or fibroblast growth factor 
to induce neovascularization within ischemic regions of the heart. More generally, 
the surgical field 106 may include any areas of a patient's body, such as a region of 
the body that includes a tumor that is to be surgically removed, and that is amenable 

20 to visualization with fluourescent dyes, such as through the use of labeled 
antibodies. 

The dye source 108 may be any instrument used for injection or other 
introduction of the dye 110 into a subject, such as a hypodermic needle or angiocath. 

25 Where, for example, the dye 1 10 is highly soluble in blood, the dye source 1 08 may 
be administered anywhere on the subject, and need not be near the surgical field 
106. For example, it has been found that IRDye78-CA (the carboxylic acid form of 
IRDye78), when injected intravenously into a live laboratory rat, produced peak 
vasculature image strength of an open heart approximately 5-10 seconds after 

30 injection, and remained adequate for visualization for over one minute. In certain 
embodiments, the dye source 108 may not use injection. For example, the dye 
source 108 may spray or otherwise apply the dye 110 to an area of interest. 
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Depending upon the type of dye and the imaging technique, the dye 110 may be 
delivered in a discrete dose, or may be continuously or intermittently applied and re- 
applied by the dye source 108. 

5 The dye 110 may be any dye suitable for use in vivo and having excitation 

and emission wavelengths suitable for other components of the system 100. 
Typically, the dye 1 10 will be diluted to 25-50 uM for intravenous injection, such as 
with phosphate buffered saline, which may be supplemented with Cremophor EL 
(Sigma) and/or absolute ethanol. A number of suitable near-infrared dyes are 

10 described below. 

'Acyl' refers to a group suitable for acylating a nitrogen atom to form an 
amide or carbamate, a carbon atom to form a ketone, a sulfur atom to form a 
thioester, or an oxygen atom to form an ester group, e.g., a hydrocarbon attached to 
15 a -C(=0)- moiety. Preferred acyl groups include benzoyl, acetyl, tert-butyl acetyl, 
pivaloyl, and trifluoroacetyl. More preferred acyl groups include acetyl and benzoyl. 
The most preferred acyl group is acetyl. 

The terms 'amine' and 'amino' are art-recognized and refer to both 
20 unsubstituted and substituted amines as well as ammonium salts, e.g., as can be 
represented by the general formula: 

R 9 Rio 

wherein R 9 , Rio, and R'io each independently represent hydrogen or a hydrocarbon 
substituent, or R 9 and Rio taken together with the N atom to which they are attached 
25 complete a heterocycle having from 4 to 8 atoms in the ring structure. In preferred 
embodiments, none of R 9 , Rio, and R'io is acyl, e.g., R 9 , Rio, and R'io are selected 
from hydrogen, alkyl, heteroalkyl, aryl, heteroaryl, carbocyclic aliphatic, and 
heterocyclic aliphatic. The term 'alkylamine' as used herein means an amine group, 
as defined above, having at least one substituted or unsubstituted alkyl attached 
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thereto. Amino groups that are positively charged (e.g., R'10 is present) are referred 
to as 'ammonium' groups. In amino groups other than ammonium groups, the amine 
is preferably basic, e.g., its conjugate acid has a pKa above 7. 

The terms 'amido' and 'amide' are art-recognized as an amino-substituted 
carbonyl, such as a moiety that can be represented by the general formula: 




wherein R 9 and Rio are as defined above. In certain embodiments, the amide will 
include imides. 

10 

'Alkyl' refers to a saturated or unsaturated hydrocarbon chain having 1 to 18 
carbon atoms, preferably 1 to 12, more preferably 1 to 6, more preferably still 1 to 4 
carbon atoms. Alkyl chains may be straight (e.g., n-butyl) or branched (e.g., sec- 
butyl, isobutyl, or /-butyl). Preferred branched alkyls have one or two branches, 

1 5 preferably one branch. Preferred alkyls are saturated. Unsaturated alkyls have one or 
more double bonds and/or one or more triple bonds. Preferred unsaturated alkyls 
have one or two double bonds or one triple bond, more preferably one double bond. 
Alkyl chains may be unsubstituted or substituted with from 1 to 4 substituents. 
Preferred alkyls are unsubstituted. Preferred substituted alkyls are mono-, di-, or 

20 trisubstituted. Preferred alkyl substituents include halo, haloalkyl, hydroxy, aryl 
(e.g., phenyl, tolyl, alkoxyphenyl, alkyloxycarbonylphenyl, halophenyl), 
heterocyclyl, and heteroaryl. 

The terms 'alkenyl' and 'alkynyl' refer to unsaturated aliphatic groups 
25 analogous in length and possible substitution to the alkyls described above, but that 
contain at least one double or triple bond, respectively. When not otherwise 
indicated, the terms alkenyl and alkynyl preferably refer to lower alkenyl and lower 
alkynyl groups, respectively. When the term alkyl is present in a list with the terms 
alkenyl and alkynyl, the term alkyl refers to saturated alkyls exclusive of alkenyls 
30 and alkynyls. 
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The terms 'alkoxyl' and 'alkoxy' as used herein refer to an -O-alkyl group. 
Representative alkoxyl groups include methoxy, ethoxy, propyloxy, tert-butoxy, and. 
the like. An 'ether' is two hydrocarbons covalently linked by an oxygen. 
5 Accordingly, the substituent of a hydrocarbon that renders that hydrocarbon an ether 
can be an alkoxyl, or another moiety such as -O-aryl, -O-heteroaryl, -O-heteroalkyl, 
-O-aralkyl, -O-heteroaralkyl, -O-carbocylic aliphatic, or -O-heterocyclic aliphatic. 

The term 'aralkyl', as used herein, refers to an alkyl group substituted with 
10 an aryl group. 

'Aryl ring' refers to an aromatic hydrocarbon ring system. Aromatic rings 
are monocyclic or fused bicyclic ring systems, such as phenyl, naphthyl, etc. 
Monocyclic aromatic rings contain from about 5 to about 10 carbon atoms, 

15 preferably from 5 to 7 carbon atoms, and most preferably from 5 to 6 carbon atoms 
in the ring. Bicyclic aromatic rings contain from 8 to 12 carbon atoms, preferably 9 
or 10 carbon atoms in the ring. The term 'aryl' also includes bicyclic ring systems 
wherein only one of the rings is aromatic, e.g., the other ring is cycloalkyl, 
cycloalkenyl, or heterocyclyl. Aromatic rings may be unsubstituted or substituted 

20 with from 1 to about 5 substituents on the ring. Preferred aromatic ring substituents 
include: halo, cyano, lower alkyl, heteroalkyl, haloalkyl, phenyl, phenoxy, or any 
combination thereof. More preferred substituents include lower alkyl, cyano, halo, 
and haloalkyl. 

25 'Cycloalkyl ring' refers to a saturated or unsaturated hydrocarbon ring. 

Cycloalkyl rings are not aromatic. Cycloalkyl rings are monocyclic, or are fused, 
spiro, or bridged bicyclic ring systems. Monocyclic cycloalkyl rings contain from 
about 4 to about 10 carbon atoms, preferably from 4 to 7 carbon atoms, and most 
preferably from 5 to 6 carbon atoms in the ring. Bicyclic cycloalkyl rings contain 

30 from 8 to 12 carbon atoms, preferably from 9 to 1 0 carbon atoms in the ring. 
Cycloalkyl rings may be unsubstituted or substituted with from 1 to 4 substituents 
on the ring. Preferred cycloalkyl ring substituents include halo, cyano, alkyl, 
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5 



heteroalkyl, haloalkyl, phenyl, phenoxy or any combination thereof. More preferred 
substituents include halo and haloalkyl. Preferred cycloalkyl rings include 
cyclopentyl, cyclohexyl, cyclohexenyl, cycloheptyl, and cyclooctyl. More preferred 
cycloalkyl rings include cyclohexyl, cycloheptyl, and cyclooctyl. 

The term 'carbonyl' is art-recognized and includes such moieties as can be 
represented by the general formula: 



O ° 





or ^ R' 



'11 



10 wherein X is a bond or represents an oxygen or a sulfur, and Rn represents a 
hydrogen, hydrocarbon substituent, or a pharmaceutically acceptable salt, Rir 
represents a hydrogen or hydrocarbon substituent. Where X is an oxygen and Rn or 
R n . is not hydrogen, the formula represents an 'ester'. Where X is an oxygen, and 
R„ is as defined above, the moiety is referred to herein as a carboxyl group, and 

15 particularly when Rn is a hydrogen, the formula represents a 'carboxylic acid'. 
Where X is an oxygen, and R u - is hydrogen, the formula represents a 'formate'. In 
general, where the oxygen atom of the above formula is replaced by sulfur, the 
formula represents a 'thiocarbonyl' group. Where X is a sulfur and R n or Rn- is not 
hydrogen, the formula represents a 'thioester.' Where X is a sulfur and Rn is 

20 hydrogen, the formula represents a 'thiocarboxylic acid.' Where X is a sulfur and 
R n . is hydrogen, the formula represents a 'thioformate.' On the other hand, where X 
is a bond, R u is not hydrogen, and the carbonyl is bound to a hydrocarbon, the 
above formula represents a 'ketone' group. Where X is a bond, Rn is hydrogen, and 
the carbonyl is bound to a hydrocarbon, the above formula represents an 'aldehyde' 

25 or 'formyl' group. 

'Ci alkyl' is an alkyl chain having i member atoms. For example, C4 alkyls 
contain four carbon member atoms. C4 alkyls containing may be saturated or 
unsaturated with one or two double bonds (cis or trans) or one triple bond. Preferred 
30 C4 alkyls are saturated. Preferred unsaturated C4 alkyl have one double bond. C4 
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alkyl may be unsubstituted or substituted with one or two substituents. Preferred 
substituents include lower alkyl, lower heteroalkyl, cyano, halo, and haloalkyl. 

'Halogen' refers to fluoro, chloro, bromo, or iodo substituents. Preferred halo 
5 are fluoro, chloro and bromo; more preferred are chloro and fluoro. 

'Heteroalkyl' is a saturated or unsaturated chain of carbon atoms and at least 
one heteroatom, wherein no two heteroatoms are adjacent Heteroalkyl chains 
contain from 1 to 18 member atoms (carbon and heteroatoms) in the chain, 

10 preferably 1 to 12, more preferably 1 to 6, more preferably still 1 to 4. Heteroalkyl 
chains may be straight or branched. Preferred branched heteroalkyl have one or two 
branches, preferably one branch. Preferred heteroalkyl are saturated. Unsaturated 
heteroalkyl have one or more double bonds and/or one or more triple bonds. 
Preferred unsaturated heteroalkyl have one or two double bonds or one triple bond, 

15 more preferably one double bond. Heteroalkyl chains may be unsubstituted or 
substituted with from 1 to about 4 substituents unless otherwise specified. Preferred 
heteroalkyl are unsubstituted. Preferred heteroalkyl substituents include halo, aryl 
(e.g., phenyl, tolyl, alkoxyphenyl, alkoxycarbonylphenyl, halophenyl), heterocyclyl, 
heteroaryl. For example, alkyl chains substituted with the following substituents are 

20 heteroalkyl: alkoxy (e.g., methoxy, ethoxy, propoxy, butoxy, pentoxy), aryloxy (e.g., 
phenoxy, chlorophenoxy, tolyloxy, methoxyphenoxy, benzyloxy, 
alkoxycarbonylphenoxy, acyloxyphenoxy), acyloxy (e.g., propionyloxy, 
benzoyloxy, acetoxy), carbamoyloxy, carboxy, mercapto, alkylthio, acylthio, 
arylthio (e.g., phenylthio, chlorophenylthio, alkylphenylthio, alkoxyphenylthio, 

25 benzylthio, alkoxycarbonylphenylthio), amino (e.g., amino, mono- and di- C1-C3 
alkylamino, methylphenylamino, methylbenzylamino, C1-C3 alkylamido, 
carbamamido, ureido, guanidino). 

'Heteroatom' refers to a multivalent non-carbon atom, such as a boron, 
30 phosphorous, silicon, nitrogen, sulfur, or oxygen atom, preferably a nitrogen, sulfur, 
or oxygen atom. Groups containing more than one heteroatom may contain different 
heteroatoms. 
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'Heteroaryl ring' refers to an aromatic ring system containing carbon and 
from 1 to about 4 heteroatoms in the ring. Heteroaromatic rings are monocyclic or 
fused bicyclic ring systems. Monocyclic heteroaromatic rings contain from about 5 

5 to about 10 member atoms (carbon and heteroatoms), preferably from 5 to 7, and 
most preferably from 5 to 6 in the ring. Bicyclic heteroaromatic rings contain from 8 
to 12 member atoms, preferably 9 or 10 member atoms in the ring. The term 
'heteroaryl' also includes bicyclic ring systems wherein only one of the rings is 
aromatic, e.g., the other ring is cycloalkyl, cycloalkenyl, or heterocyclyl. 

10 Heteroaromatic rings may be unsubstituted or substituted with from 1 to about 4 
substituents on the ring. Preferred heteroaromatic ring substituents include halo, 
cyano, lower alkyl, heteroalkyl, haloalkyl, phenyl, phenoxy or any combination 
thereof. Preferred heteroaromatic rings include thienyl, thiazolyl, oxazolyl, pyrrolyl, 
purinyl, pyrimidyl, pyridyl, and furanyl. More preferred heteroaromatic rings 

1 5 include thienyl, furanyl, and pyridyl. 

'Heterocyclic aliphatic ring' is a non-aromatic saturated or unsaturated ring 
containing carbon and from 1 to about 4 heteroatoms in the ring, wherein no two 
heteroatoms are adjacent in the ring and preferably no carbon in the ring attached to 

20 a heteroatom also has a hydroxyl, amino, or thiol group attached to it. Heterocyclic 
aliphatic rings are monocyclic, or are fused or bridged bicyclic ring systems. 
Monocyclic heterocyclic aliphatic rings contain from about 4 to about 10 member 
atoms (carbon and heteroatoms), preferably from 4 to 7, and most preferably from 5 
to 6 member atoms in the ring. Bicyclic heterocyclic aliphatic rings contain from 8 

25 to 12 member atoms, preferably 9 or 10 member atoms in the ring. Heterocyclic 
aliphatic rings may be unsubstituted or substituted with from 1 to about 4 
substituents on the ring. Preferred heterocyclic aliphatic ring substituents include 
halo, cyano, lower alkyl, heteroalkyl, haloalkyl, phenyl, phenoxy or any 
combination thereof. More preferred substituents include halo and haloalkyl. 

30 Heterocyclyl groups include, for example, thiophene, thianthrene, furan, pyran, 
isobenzofuran, chromene, xanthene, phenoxathin, pyrrole, imidazole, pyrazole, 
isothiazole, isoxazole, pyridine, pyrazine, pyrimidine, pyridazine, indolizine, 
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isoindole, indole, indazole, purine, quinolizine, isoquinoline, hydantoin, oxazoline, 
imidazolinetrione, triazolinone, quinoline, phthalazine, naphthyridine, quinoxaline, 
quinazoline, quinoline, pteridine, carbazole, carboline, phenanthridine, acridine, 
phenanthroline, phenazine, phenarsazine, phenothiazine, furazan, phenoxazine, 
pyrrolidine, oxolane, thiolane, oxazole, piperidine, piperazine, morpholine, lactones, 
lactams such as azetidinones and pyrrolidinones, sultams, sultones, and the like. 
Preferred heterocyclic aliphatic rings include piperazyl, morpholinyl, 
tetrahydrofuranyl, tetrahydropyranyl and piperidyl. Heterocycles can also be 
polycycles. 

The term 'hydroxyl' means -OH. 



'Lower alkyl' refers to an alkyl chain comprised of 1 to 4, preferably 1 to 3 
carbon member atoms, more preferably 1 or 2 carbon member atoms. Lower alkyls 

15 may be saturated or unsaturated. Preferred lower alkyls are saturated. Lower alkyls 
may be unsubstituted or substituted with one or about two substituents. Preferred 
substituents on lower alkyl include cyano, halo, trifluoromethyl, amino, and 
hydroxyl. Throughout the application, preferred alkyl groups are loweT alkyls. In 
preferred embodiments, a substituent designated herein as alkyl is a lower alkyl. 

20 Likewise, 'lower alkenyl' and 'lower alkynyl' have similar chain lengths. 

'Lower heteroalkyl' refers to a heteroalkyl chain comprised of 1 to 4, 
preferably 1 to 3 member atoms, more preferably 1 to 2 member atoms. Lower 
heteroalkyl contain one or two non-adjacent heteroatom member atoms. Preferred 
25 lower heteroalkyl contain one heteroatom member atom. Lower heteroalkyl may be 
saturated or unsaturated. Preferred lower heteroalkyl are saturated. Lower 
heteroalkyl may be unsubstituted or substituted with one or about two substituents. 
Preferred substituents on lower heteroalkyl include cyano, halo, trifluoromethyl, and 
hydroxyl. 



30 



'Mi heteroalkyl' is a heteroalkyl chain having i member atoms. For example, 
M4 heteroalkyls contain one or two non-adjacent heteroatom member atoms. M4 
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heteroalkyls containing 1 heteroatom member atom may be saturated or unsaturated 
with one double bond (cis or .trans) or one triple bond. Preferred M4 heteroalkyl 
containing 2 heteroatom member atoms are saturated. Preferred unsaturated M4 
heteroalkyl have one double bond. M4 heteroalkyl may be unsubstituted or 
5 substituted with one or two substituents. Preferred substituents include lower alkyl, 
lower heteroalkyl, cyano, halo, and haloalkyl. 

'Member atom' refers to a polyvalent atom (e.g., C, O, N, or S atom) in a 
chain or ring system that constitutes a part of the chain or ring. For example, in 
10 cresol, six carbon atoms are member atoms of the ring and the oxygen atom and the 
carbon atom of the methyl substituent are not member atoms of the ring. 

As used herein, the term c nitro' means -NO2. 

15 Tharmaceutically acceptable salt' refers to a cationic salt formed at any 

acidic (e.g., hydroxamic or carboxylic acid) group, or an anionic salt formed at any 
basic (e.g., amino or guanidino) group. Such salts are well known in the art. See e.g., 
World Patent Publication 87/05297, Johnston et al., published September 11, 1987, 
incorporated herein by reference. Such salts are made by methods known to one of 

20 ordinary skill in the art. It is recognized that the skilled artisan may prefer one salt 
over another for improved solubility, stability, formulation ease, price and the like. 
Determination and optimization of such salts is within the purview of the skilled 
artisan's practice. Preferred cations include the alkali metals (such as sodium and 
potassium), and alkaline earth metals (such as magnesium and calcium) and organic 

25 cations, such as trimethylammonium, tetrabutylammonium, etc. Preferred anions 
include halides (such as chloride), sulfonates, carboxylates, phosphates, and the like. 
Clearly contemplated in such salts are addition salts that may provide an optical 
center where once there was none. For example, a chiral tartrate salt may be 
prepared from the compounds of the invention. This definition includes such chiral 
30 salts. 
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'Phenyl* is a six-membered monocyclic aromatic ring that may or may not 
be substituted with from 1 to 5 substituents. The substituents may be located at fee 
ortho, meta or para position on the phenyl ring, or any combination thereof. 
Prefeixed phenyl substituents include: halo, cyano, lower alkyl, heteroalkyl, 
5 haloalkyl, phenyl, phenoxy or any combination thereof. More preferred substituents 
on the phenyl ring include halo and haloalkyl. The most preferred substituent is halo. 

The terms 'polycyclyl' and 'polycyclic group' refer to two or more rings 
(e.g., cycloalkyls, cycloalkenyls, heteroaryls, aryls and/or heterocyclyls) in which 
10 two or more member atoms of one ring are member atoms of a second ring. Rings 
that are joined through non-adjacent atoms are termed 'bridged 5 rings, and rings that 
are joined through adjacent atoms are 'fused rings'. 

The term 'sulfate' is art-recognized and includes a moiety that can be 
1 5 represented by the general formula: 

V R 

in which Rio is as defined ahove. 

A 'substitution' or 'substituent' on a small organic molecule generally refers 
20 to a position on a multivalent atom bound to a moiety other than hydrogen, e.g., a 
position on a chain or ring exclusive of the member atoms of the chain or ring. Such 
moieties include those defined herein and others as are known in the art, for 
example, halogen, alkyl, alkenyl, alkynyl, azide, haloalkyl, hydroxyl, carbonyl (such 
as carboxyl, alkoxycarbonyl, formyl, ketone, or acyl), thiocarbonyl (such as 
25 thioester, thioacetate, or thioformate), alkoxyl, phosphoryl, phosphonate, 
phosphinate, amine, amide, amidine, imine, cyano, nitro, azido, sulfhydryl, 
alkylthio, sulfate, sulfonate, sulfamoyl, sulfonamide, sulfonyl, silyl, ether, 
cycloalkyl, heterocyclyl, heteroalkyl, heteroalkenyl, and heteroalkynyl, 
heteroaralkyl, aralkyl, aryl or heteroaryl. It will be understood by those skilled in the 
30 art that certain substituents, such as aryl, heteroaryl, polycyclyl, alkoxy, alkylamino, 
alkyl, cycloalkyl, heterocyclyl, alkenyl, alkynyl, heteroalkyl, heteroalkenyl, and 
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heteroalkynyl, can themselves be substituted, if appropriate. This invention is not 
intended to be limited in any manner by the permissible substituents of organic 
compounds. It will be understood that 'substitution' or 'substituted with' includes 
the implicit proviso that such substitution is in accordance with permitted valence of 
5 the substituted atom and the substituent, and that the substitution results in a stable 
compound, e.g., which does not spontaneously undergo transformation such as by 
rearrangement, cyclization, elimination, hydrolysis, etc. 

As used herein, the definition of each expression, e.g., alkyl, m, n, etc., when 
10 it occurs more than once in any structure, is intended to be independent of its 
definition elsewhere in the same structure. 

The abbreviations Me, Et, Ph, Tf, Nf, Ts, and Ms represent methyl, ethyl, 
phenyl, trifluoromethanesulfonyl, nonafluorobutanesulfonyl, p-toluenesulfonyl, and 

15 methanesulfonyl, respectively. A more comprehensive list of the abbreviations 
utilized by organic chemists of ordinary skill in the art appears in the first issue of 
each volume of the Journal of Organic Chemistry', this list is typically presented in a 
table entitled Standard List of Abbreviations . The abbreviations contained in said 
list, and all abbreviations utilized by organic chemists of ordinary skill in the art are 

20 hereby incorporated by reference. 

For purposes of this invention, the chemical elements are identified in 
accordance with the Periodic Table of the Elements, CAS version, Handbook of 
Chemistry and Physics, 67th Ed., 1986-87, inside cover. Also for purposes of this 
25 invention, the term 'hydrocarbon' is contemplated to include all permissible 
compounds or moieties having at least one carbon-hydrogen bond. In a broad aspect, 
the permissible hydrocarbons include acyclic and cyclic, branched and unbranched, 
carbocyclic and heterocyclic, aromatic and nonaromatic organic compounds which 
can be substituted or unsubstituted. 

30 

Contemplated equivalents of the compounds described above include 
compounds which otherwise correspond thereto, and which have the same useful 



23 



WO 03/077749 



PCT/US03/07596 



properties thereof, wherein one or more simple variations of substituents are made 
which do not adversely affect the efficacy of the compound. In general, the 
compounds of the present invention may be prepared by the methods illustrated in 
the general reaction schemes as, for example, described below, or by modifications 
5 thereof, using readily available starting materials, reagents and conventional 
synthesis procedures. In these reactions, it is also possible to make use of variants 
that are in themselves known, but are not mentioned here. 

In certain embodiments, the subject method employs a fluorescent dye 
1 0 having a structure of the formula: 




wherein, as valence and stability permit, 
X represents C(R) 2 , S, Se, O, or NR 5 ; 

R represents H or lower alkyl, or two occurrences of R, taken together, form a ring 
together with the carbon atoms through which they are connected; 

Rj and R 2 represent, independently, substituted or unsubstituted lower alkyl, lower 
alkenyl, cycloalkyl, cycloalkylalkyl, aryl, or aralkyl, e.g., optionally 
substituted by sulfate, phosphate, sulfonate, phosphonate, halogen, hydroxyl, 
amino, cyano, nitro, carboxylic acid, amide, etc., or a phannaceutically 
acceptable salt thereof; 

R 3 represents, independently for each occurrence, one or more substituents to the 
ring to which it is attached, such as a fused ring (e.g., a benzo ring), sulfate, 
phosphate, sulfonate, phosphonate, halogen, lower alkyl, hydroxyl, amino, 
cyano, nitro, carboxylic acid, amide, etc., or a phannaceutically acceptable 
salt thereof; 



15 



20 



25 
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R4 represents H, halogen, or a substituted or unsubstituted ether or thioether of 

phenol or thiophenol; and p 
R 5 represents, independently for each occurrence, substituted or unsubstituted lower 
alkyl, cycloalkyl, cycloalkylalkyl, aryl, or aralkyl, e.g., optionally substituted 
5 by sulfate, phosphate, sulfonate, phosphonate, halogen, hydroxyl, amino, 

cyano, nitro, carboxylic acid, amide, etc., or a pharmaceutical^ acceptable 
salt thereof. 

Dyes representative of this formula include indocyanine green, as well as: 

10 




In certain embodiments wherein two occurrences of R taken together form a 
ring, the ring is six-membered, e.g., the fluorescent dye has a structure of formula: 




wherein X, Ri, R2,R3, R4, and R 5 represent substituents as described above. 

Dyes representative of this formula include IRDye78, ERDye80, IRDye38, 
IRDye40, IRDye41, IRDye700, IRDye800, Cy7 (AP Biotech), and compounds 
20 formed by conjugating a second molecule to any such dye, e.g., a protein or nucleic 
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acid conjugated to IRDye800, IRDye40, or Cy7, etc. The IRDyes are commercially 
available from Li-Cor Biosciences of Lincoln, Nebraska, and each dye has a 
specified peak absorption wavelength (also referred to herein as the excitation 
wavelength) and peak emission wavelength that may be used to select suitable 
5 optical hardware for use therewith. It will be appreciated that other dyes may also 
be used, including the far-red dyes noted above, provided suitable adjustments are 
made to the visible light imaging components of the system 100, and other near- 
infrared dyes or infrared substances such as the previously mentioned quantum dots. 
Several specific dyes suited for specific imaging techniques are now described. 

10 

ERDye78-CA is useful for imaging the vasculature of the tissues and organs. 
The dye in its small molecule form is soluble in blood, and has an in vivo early half- 
life of several minutes. This permits multiple injections during a single procedure. 
Indocyanine green has similar characteristics, but is somewhat less soluble in blood 
1 5 and has a shorter half-life. IRDye78 may also be used in other imaging applications, 
since it can be conjugated to tumor-specific ligands for tumor visualization. More 
generally, ERDye78 may be linked to an antibody, antibody fragment, or ligand 
associated with a tumor. Presence of the tumor or lesion may then be visualized 
using the techniques described above. 

20 

As another example, IR-786 partitions efficiently into mitochondria and/or 
endoplasmic reticulum in a concentration-dependent manner, thus permitting blood 
flow and ischemia visualization in a living heart. The dye has been successfully 
applied, for example, to image blood flow in the heart of a living laboratory rat after 
25 a thoracotomy. More generally, IR-786 may be used for non-radioactive imaging of 
areas of ischemia in the living heart, or other visualization of the viability of other 
tissues. 

While a number of suitable dyes have been described, it should be 
30 appreciated that such fluorescent dyes are examples only, and that more generally, 
any fluorescent substance may be used with the imaging systems described herein, 
provided the substance has an emission wavelength that does not interfere with 
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visible light imaging. This includes the fluorescent dyes described above, as well as 
substances such as quantum dots which may have emission wavelengths above 1000 
nm } and may be associated with an antibody, antibody fragment, or ligand and 
imaged in vivo. All such substances are referred to herein as fluorescent substances, 
5 and it will be understood that suitable modifications may be made to components of 
the imaging system for use with any such fluorescent substance. 

The lens 112 may be any lens suitable for receiving light from the surgical 
field 106 and focusing the light for image capture by the near-infrared camera 120 
10 and the video camera 122. The lens 112 may include one or more optical coatings 
suitable for the wavelengths to be imaged, and may provide for manual, 
electronically-assisted manual, or automatic control of zoom and focus. 

The first filter 114 may be positioned in the image path from the lens 112 

15 such that a visible light image having one or more visible light wavelengths is 

directed toward the video camera 122, either by reflection or transmittance. An 

emission image from the excited dye 1 10 passes through the lens 1 12 and is directed 

toward the near infrared camera 120, again either through reflection or 

transmittance. A number of arrangements of the cameras 120, 122 and the first filter 

20 114 are possible, and may involving reflecting or transmitting either the visible light 

image or the emission wavelength image. 

* 

In one embodiment, IRDye78-CA (carboxylic acid) having a peak absorption 
near 771 nm and a peak emission near 806 nm, is used with the system 100. In this 

25 embodiment, the first filter 1 14 may be a 785 nm dichroic mirror that transmits near- 
infrared light and reflects visible light. The first filter 1 14 may be positioned within 
an image path from the lens 112 such that a visible light image of the surgical field 
106 is reflected toward the video camera 122 through the third filter 118. The third 
filter 1 1 8 may be, for example, a 400 nm - 700 nm visible light filter. At the same 

30 time, the first filter 1 14 is positioned with the image path from the lens 1 12 such that 
a near-infrared image (i.e., the excitation wavelength image) is transmitted toward 
the near-infrared camera 120 through the second filter 116. The second filter 116 
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may be an 810 ran +/- 20 nm near-infrared emission filter. The filters may be 
standard or custom-ordered optical components, which are commercially available 
from optical component suppliers. Other arrangements of filters and other optical 
components may be used with the system 100 described herein. 

5 

The near-infrared camera 120 may be any still or moving image camera 
suitable for capturing images at the emission wavelength of the excited dye 110. 
The near-infrared camera may be, for example, an Orca-ER near-infrared camera 
with settings of gain 7, 2 x 2 binning, 640 x 480 pixel field of view, and an exposure 

10 time of 20 msec and an effective frame rate of fifteen frames per second. The Orca- 
ER is commercially available from Hamamatsu Photonic Systems of Bridgewater, 
New Jersey. It will be understood that the near-infrared camera 120 of Fig. 1 is only 
an example. An infrared camera, a far-red camera, or some other camera or video 
device may be used to capture an emission wavelength image, with the camera and 

15 any associated filters selected according to the wavelength of a corresponding 
fluorescent substance used with the imaging system. As used herein, the term 
"emission wavelength camera" is intended to refer to any such camera that may be 
used with the systems described herein. 

20 The video camera 122 may be any video camera suitable for capturing 

images of the surgical field 106 in the visible light spectrum. In one embodiment, 
the video camera 122 is a color video camera model HV-D27, commercially 
available from Hitachi of Tarrytown, New York. The video camera 122 may 
capture red-green-blue (RGB) images at thirty frames per second at a resolution of 

25 640 x 480 pixels. More generally, the near-infrared camera 120 and the video 
camera 122 may be any device capable of photonic detection and conversion to 
electronic images, including linear photodiode arrays, charge coupled device arrays, 
scanning photomultiplier tubes, and so forth. 

30 The display 126 may be a television, high-definition television, computer 

monitor, or other display configured to receive and render signals from the image 
processing unit 124. The surgical field 106 may also be a neurosurgical site, with a 
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surgical microscope used to view the surgical field 106. In this embodiment, the 
display 126 may be a monocular or binocular eyepiece of the surgical microscope, 
with the near-infrared image superimposed on the visible light image in the 
eyepiece. In another embodiment, the eyepiece may use direct optical coupling of 
5 the surgical field 106 to the eyepiece for conventional microscopic viewing, with the 
near-infirared image projected onto the eyepiece using, for example, heads-up 
display technology. 

The image processing unit 124 may include any software and/or hardware 
10 suitable for receiving images from the cameras 120, 122, processing the images as 
desired, and transmitting the images to the display 126. In one embodiment, the 
image processing unit 124 is realized in software on a Macintosh computer equipped 
with a Digi-16 Snapper frame grabber for the Orca-ER, commercially available from 
DataCell of North Billerica, Massachussets, and equipped with a CG-7 frame 
1 5 grabber for the HV-D27, commercially available from Scion of Frederick Maryland, 
and using IPLab software, commercially available from Sanalytics of Fairfax, 
Virginia. While a Macintosh may be used in one embodiment, any general purpose 
computer may be programmed to perform the image processing functions described 
herein, including an Intel processor-based computer, or a computer using hardware 
20 from Sun Microsystems, Silicon Graphics, or any other microprocessor 
manufacturer. 

Generally, the image processing unit 124 should be capable of digital 
filtering, gain adjustment, color balancing, and any other conventional image 

25 processing functions. The image from the near-infrared camera 120 is also typically 
shifted into the visible light Tange for display at some prominent wavelength, e.g., a 
color distinct from the visible light colors of the surgical field 106, so that a 
superimposed image will clearly depict the dye. The image processing unit 124 may 
also perform image processing to combine the image from the near-infrared camera 

30 120 and the video camera 122. Where the images are displayed side-by-side, this 
may simply entail rendering the images in suitable locations on a computer screen. 
Where the images are superimposed, a frame rate adjustment may be required. That 
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is, if the video camera 122 is capturing images at the conventional rate of thirty 
frames per second and the near-infrared camera 120 is taking still pictures with an 
effective frame rate of fifteen frames per second, some additional processing maybe 
required to render the superimposed images concurrently. This may entail either 
5 reducing the frame rate of the video camera 122 to the frame rate of the near- 
infrared camera 120 either by using every other frame of video data or averaging or 
otherwise interpolating video data to a slower frame rate. This may instead entail 
increasing the frame rate of the near-infrared image data, either by holding each 
frame of near-infrared data over successive frames of video data or extrapolating 
10 near-infrared data, such as by warping the near-infrared image according to changes 
in the video image or employing other known image processing techniques. 

Generally, any combination of software or hardware may be used in the 
image processing unit 124. The functions of the image processing unit 124 may be 

15 realized, for example, in one or more microprocessors, microcontrollers, embedded 
microcontrollers, programmable digital signal processors or other programmable 
device, along with internal and/or external memory such as read-only memory, 
programmable read-only memory, electronically erasable programmable read-only 
memory, random access memory, dynamic random access memory, double data rate 

20 random access memory, Rambus direct random access memory, flash memory, or 
any other volatile or non-volatile memory for storing program instructions, program 
data, and program output or other intermediate or final results. The functions may 
also, or instead, include one or more application specific integrated circuits, 
programmable gate arrays, programmable array logic devices, or any other device or 

25 devices that may be configured to process electronic signals. Any combination of 
the above circuits and components, whether packaged discretely, as a chip, as a 
chipset, or as a die, may be suitably adapted to use with the systems described 
herein. 

30 It will further be appreciated that each function of the image processing unit 

124 may be realized as computer executable code created using a structured 
programming language such as C, an object-oriented programming language such as 
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C++ or Java, or any other high-level or low-level programming language that may 
be compiled or interpreted to run on one of the above devices, as well as 
heterogeneous combinations of processors, processor architectures, or combinations 
of different hardware and software. The image processing unit 124 may be 
5 deployed using software technologies or development environments including a mix 
of software languages, such as Java, C++, Oracle databases, SQL, and so forth. It 
will be further appreciated that the functions of the image processing unit 124 may 
be realized in hardware, software, or some combination of these. 

10 In one embodiment, the visible light source 102 is a near-infrared depleted 

visible light source, the excitation light source 104 is a 771 nm, 250 mW laser diode, 
the dye 110 is indocyanine green or IRDye78-CA, the first filter 114 is a 785 nm 
dichroic mirror configured to transmit near-infrared light and reflect visible light, the 
second filter 116 is an 810 nm +/- 20 nm near-infrared emission filter, and the third 

1 5 filter 1 1 8 is a 400 nm to 700 nm filter. The image processing unit 124 is a computer 
with software for image capture from the near-infrared camera 120 and the video 
camera 122, for making suitable color adjustment to the images from the near- 
infrared camera 120, for making frame rate adjustments to the video camera 122 
image, and for combining the two images for superimposed display on the display 

20 126. 

The systems described above have numerous surgical applications. For 
example, the system may be deployed as an aid to cardiac surgery, where it may be 
used intraoperatively for direct visualization of cardiac blood flow, for direct 

25 visualization of myocardium at risk for infarction, and for image-guided placement 
of gene therapy and other medicinals to areas of interest. The system may be 
deployed as an aid to oncological surgery, where it may be used for direct 
visualization of tumor cells in a surgical field or for image-guided placement of gene 
therapy and other medicinals to an area of interest The system may be deployed as 

30 an aid to general surgery for direct visualization of any function amenable to 
imaging with fluorescent dyes, including blood flow and tissue viability. In 
dermatology, the system may be used for sensitive detection of malignant cells or 
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other skin conditions, and for non-surgical diagnosis of dermatological diseases 
using near-infrared ligands and/or antibodies. 

Figure 2 shows a near-infrared window used by the imaging system. The 

5 near-infrared window 200 is characterized by wavelengths where absorbance is at a 
minimum. The components of living tissue with significant near-infrared 
absorbance include water 204, lipid 208, oxygenated hemoglobin 210, and 
deoxygenated hemoglobin 212. As shown in Fig. 2, oxygenated hemoglobin 210 
and deoxygenated hemoglobin have significant absorbance below 700 nm. By 

10 contrast, lipids 208 and water 204 have significant absorbance above 900 nm. 
Between 700 nm and 900 nm, these absorbances reach a cumulative minimum 
referred to as the near-infrared window 200. While use of excitation and emission 
wavelengths outside the near-infrared window 200 is possible, as described in some 
of the examples above, fluorescence imaging within the near-infrared window 200 

15 offers several advantages including low tissue autofluorescence, minimized tissue 
scatter, and relatively deep penetration depths. While the near-infrared window 200 
is one useful wavelength range for imaging, the systems described herein are not 
limited to either excitation or emission wavelengths in this window, and may 
employ, for example, far-red light wavelengths below the near-infrared window 200, 

20 or infrared light wavelengths above the near-infrared window 200, both of which 
may be captured using commercially available imaging equipment 

Figure 3 shows an embodiment of an imaging system for use in an 
endoscopic tool. The imaging system 300 may include a visible light source 302, 

25 and excitation light source 304, a surgical field 306, a dye source 308 containing a 
dye 310, a lens 312, a first filter 314, a second filter 316, a third filter 318, a near- 
infrared camera 320, a video camera 322, an image processing unit 324, and a 
display 326. In general, the visible light source 302 and the excitation light source 
304 illuminate the surgical field 306. The dye 310 may be introduced from the dye 

30 source 308, such as through injection into the bloodstream of a subject. An image 
from the surgical field 306 is then captured by two cameras, the video camera 322 
capturing a conventional, visible light image of the surgical field 306 and the near- 
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infrared camera 320 capturing a diagnostic image based upon the distribution of the 
dye 310 in the surgical field 306. These images may be combined by the image 
processing unit 324 and presented on a display 326 where they may be used, for 
example, by a surgeon conducting a surgical procedure. In general, each of these 
5 components may be any of those components similarly described with reference to 
Fig. 1 above. Differences for an endoscopic tool are now described. 

The imaging system 300 for use as an endoscopic tool may further include a 
first lens/collimator 303 for the visible light source, a second lens/collimator 305 for 
10 the excitation light source 304, an optical coupler 307 that combines the excitation 
light and the visible light, a dichroic mirror 309, and an endoscope 311 having a first 
cavity 313 and a second cavity 315. 

The first lens/collimator 303, the second lens/collimator 305, and the optical 
15 coupler 307 serve to combine the excitation light and the visible light into a single 
light source. This light source is coupled into the first cavity 313 through the 
dichroic mirror 309. In one embodiment, the dichroic mirror 309 preferably 
provides fifty percent reflection of light having wavelengths from 400 cm to 700 
nm, in order to optimize an intensity of visible light that reaches the video camera 
20 322 after illuminating the surgical field 306 and passing through the dichroic mirror 
309 on its return path to the video camera 322. The dichroic mirror 309 also 
preferably has greater than ninety percent reflection of wavelength from the 
excitation light source 304, such as between 700 nm and 785 nm, so that these 
wavelengths are not transmitted to the cameras 320, 322 after reflecting off the 
25 surgical field. Using this arrangement, visible and excitation light sources 302, 304 
share the first cavity 313 of the endoscope with the return light path for a visible 
light image and an emission wavelength image. 

The second cavity 315 of the endoscope 311 may be provided for insertion of 
30 a tool, such as an optical tool like a laser for irradiation of a site in the surgical field 
306, or a physical tool like an instrument for taking a biopsy of tissue within the 
surgical field. By combining the optical paths of the imaging system 300 within a 
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single cavity of the endoscope 311, the combined gauge of the first cavity 313 for 
imaging and the second cavity 315 may be advantageously reduced. 

The imaging system 300 may instead be used with a laparoscope. Typically, 
5 a laparoscope is inserted into a body cavity through an incision, as distinguished 
from an endoscope which is inserted through an existing body opening such as the 
throat or rectum. A laparoscope has a different form factor than an endoscope, 
including different dimensional requirements. Furthermore, use of a laparascope 
involves at least one additional step of making an incision into a body so that the 
10 laparascope may be inserted into a body cavity. The laparoscope may be used with 
any of the imaging systems described above, and the imaging system 300 of Fig. 3 
in particular would provide the benefit of a narrower bore for illumination and 
imaging optics. 

15 It will further be appreciated that the imaging system 300 may be used to 

simplify imaging devices other than endoscopes and laparoscopes, such as by 
providing an integrated, coaxial illumination and image capture device using the 
techniques described above. 

20 In addition to the surgical applications noted above in reference to Fig. 1, the 

endoscopic tool of Fig. 3 may be used for direct visualization of malignant or pre- 
malignant areas within a body cavity, or for image-guided placement of gene 
therapy and other medicinals to an area of interest within the body cavity. 

25 Figure 4 shows an image displaying both a circulatory system and 

surrounding tissue. As described above, a visible light tissue image 402 is captured 
of tissue within a surgical field. As noted above, the visible light tissue image 402 
may include a subset of visible light wavelengths when an optical channel for dye 
imaging includes a wavelength within the visible light range. A near-infrared image 

30 404 is also captured of the same (or an overlapping) field of view of the surgical 
field. Although referred to here for convenience as a near-infrared image, it should 
be clear that the dye-based image 404 may also, or instead, employ other 



34 



WO 03/077749 



PCT/US03/07596 



wavelengths, such as far-red or infrared wavelengths. The near-infrared image 404 
may be shifted to a visible wavelength for display, preferably using a color that is 
prominent when superimposed on the visible light tissue image 402. The images 
402, 404 may be frame-rate adjusted as appropriate for video display of the surgical 
5 field. 

The images may be displayed separately as the visible light tissue image 402 
and the near-infrared image 404. Or the images 402, 404 may be combined into a 
combined image 406 by the image processing unit described above. The combined 
image 406 may then be used as an aid to the procedures described above, or to any 
10 other surgical or diagnostic procedure that might benefit from the dye-based imaging 
techniques described herein. 

It will be appreciated that the above functionality is merely illustrative, and 
that other dyes, imaging hardware, and optics may be usefully deployed with the 
imaging systems described herein. For example, an endoscopic tool may employ a 

1 5 still-image imaging system for diagnostic photography within a body cavity. Or any 
of the imaging systems may be used as described above with excitation and/or 
emission wavelengths in the far-red spectrum. Through minor adaptations that 
would be clear to one of ordinary skill in the art, the system could be configured to 
image two or more functions (i.e., tumor and blood flow) at the same time that a 

20 visible light image is captured by associating each function with a different dye 
having a different emission wavelength. Non-medical applications exist for the 
imaging system. For example, dyes in a solution form may be sprayed on a 
mechanical component to identify oxidation, surface defects, or the like. Dyes could 
also be used to track gas, steam, or air flow through a pressurized system, and in 

25 particular to identify leaks around fittings and valves. These and other arrangements 
and adaptations of the subject matter discussed herein are intended to fall within the 
scope of the invention. 

Thus, while the invention has been disclosed in connection with the preferred 
embodiments shown and described in detail, various modifications and 
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improvements thereon will become readily apparent to those skilled in the art. It 
should be understood that all matter contained in the above description or shown in 
the accompanying drawings shall be interpreted as illustrative, and not in a limiting 
sense, and that the following claims should be interpreted in the broadest sense 
5 allowable by law. 
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